example raster compression using Vortex#7708
Conversation
Signed-off-by: Andrew Duffy <andrew@a10y.dev>
|
I suspect we could actually squeeze out a lot of compression if we retiled into 32x32 (1024 element) vectors, and FFOR'ed each of them. Then every tile becomes a column, not a row, and each one should bitpack appropriately. This also lets us combine projection pruning for tile selection + filtering to extract a subset of a tile. Makes it very easy to turn random rectangular ranges of the image into something we can trivially push down into a scan. Plus, each 1024-element vector would probably pack relatively well. |
|
This PR has been marked as stale because it has been open for 14 days with no activity. Please comment or remove the stale label if you wish to keep it active, otherwise it will be closed in 7 days |
|
This PR was closed because it has been inactive for 7 days since being marked as stale. |
1 participant
Just an experiment for now. Idea being, why not store raster data in Vortex.
I've run some local benchmarks extracting crops out of a local GeoTIFF.
Vortex wins by a wide margin, but it's kind of cheating because
Next steps
List<u8>